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(54) Audio signal coding and decoding apparatus 

(57) An audio signal coding apparatus comprises a 
first-stage encoder for quantizing the time-to-frequency 
transformed audio signal; second-and-subsequent- 
stages of encoders each for quantizing a quantization 
error output from the previous-stage encoder; a charac- 
teristic decision unit which decides the frequency band 
of an audio signal to be quantized by each encoder of 
multiple-stage encoders; and a coding band control unit 
which receives the frequency band decided by the char- 
acteristic decision unit and the time-to-frequency trans- 
formed audio signal, decides the order of connecting 
the respective encoders, and transforms the quantiza- 
tion bands of the encoders and the connecting order to 
code sequences. Therefore, it is possible to provide an 
audio signal coding apparatus performing adaptive 
scalable coding, which exhibits sufficient performance 
when coding various audio signals. 
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Description 

FIELD OF THE INVENTION 

5 [0001 ] The present invention relates to an audio signal coding apparatus which efficiently encodes the signal which 
is obtained by transforming an audio signal such as a voice signal or music signal by using a method like the orthogonal 
transformation, so as to represent the same with less code sequences with relative to the.original audio signal, using 
the characteristics quantity which is obtained from the audio signal itself. The invention also relates to an audio signal 
decoding apparatus which can decode a high-quality and broad-band audio signal by using all or part of the code 

10 sequences as the coded signal. 

BACKGROUND OF THE INVENTION 

[0002] There have been proposed various methods for efficiently coding and decoding audio signals. As compressive 
15 coding methods for audio signals having frequency bands exceeding 20kHz such as music signals, MPEG audio and 
Twin VQ (TC-WVQ) have been proposed. In a coding method represented by MPEG audio system, a digital audio sig- 
nal on time axis is transformed to data on frequency axis by using orthogonal transformation such as cosine transfor- 
mation, and the data on frequency axis are encoded from acoustically important ones by utilizing acoustic 
characteristics of human beings, while acoustically unimportant data and redundant data are not encoded. On the other 
20 hand, Twin VQ (TC-WVQ) is a coding method in which an audio signal is represented with data quantity considerably 
smaller than that of the original digital signal by using vector quantization. MPEG audio and Twin VQ are described in 
"ISO/IEC standard IS-1 1 172-3" and "T.Moriya, H.Suga: An 8 Kbits transform coder for noisy channels, Proc. ICASSP 
89, pp.196-199", respectively. 

[0003] Hereinafter, the outline of the general Twin VQ system will be described with reference to figure 10. 

25 [0004] An original audio signal 101 is input to an analysis scale decision unit 102 to calculate an analysis scale 1 12. 
At the same time, the analysis scale decision unit 1 02 quantizes the analysis scale 1 12 to output an analysis scale code 
sequence 111. Next, a time-to-frequency transformation unit 1 03 transforms the original audio signal 1 01 to an original 
audio signal 104 in frequency domain. Next, a normalization unit (flattening unit) 106 subjects the original audio signal 
104 in frequency domain to normalization (flattening) to obtain an audio signal 108 after normalization. This normaliza- 

30 tion is performed by calculating a frequency outline 1 05 from the original audio signal 1 04 and then dividing the original 
audio signal 104 with the frequency outline 1 05 calculated. Further, the normalization unit 1 06 quantizes frequency out- 
line information used for the normalization to output a normalized code sequence 107. Next, a vector quantization unit 
109 quantizes the audio signal 108 after normalization to obtain a code sequence 1 10. 

[0005] In recent years, there has been proposed a decoder having a structure capable of reproducing an audio signal 
35 by using part of code sequences input thereto. This structure is called "scalable structure", and to encode an audio sig- 
nal so as to realize the scalable structure is called "scalable coding". 

[0006] Figure 1 1 shows an example of fixed scalable coding which is employed in general Twin VQ system. 
[0007] According to an analysis scale 1314 decided from an original audio signal 1301 by an analysis scale decision 
unit 1303, an original audio signal 1304 in frequency domain is obtained by a time-to-frequency conversion unit 1302. 

40 A low-band encoder 1 305 receives the original audio signal 1 304 in frequency domain and outputs a quantization error 
1306 and a low-band code sequence 131 1 . An intermediate-band encoder 1307 receives the quantization error 1306 
and outputs a quantization error 1308 and an intermediate-band code sequence 1312. A high-band encoder 1309 
receives the quantization error 1308 and outputs a quantization error 1310 and a high-band code sequence 1313. Each 
of the low-band, intermediate-band, and high-band encoders comprises a normalization unit and a vector quantization 

45 unit, and outputs a low-band, or intermediate band, or high-band code sequence including a quantization error and 
code sequences output from the normalization unit and the vector quantization unit. ' 
[0008] In the conventional fixed scalable coding shown in figure 1 1 , since the low-band, intermediate-band, and high- 
band encoders (quantizers) are fixed, it is difficult to encode the original audio signal so as to minimize the quantization 
errors against the distribution of the original audio signal as shown in figure 12. Therefore, when coding audio signals 

so having various characteristics and distributions, sufficient performance is not exhibited, and high-quality and high-effi- 
ciency scalable coding cannot be realized. 

SUMMARY OF THE INVENTION 

55 [0009] The present invention is made to solve the above-described problems and has for its object to provide an audio 
signal coding apparatus which efficiently encodes various audio signals at low bit rate, with high sound quality, by sub- 
jecting the audio signals to adaptive scalable coding as shown in figure 1 3. 

[0010] It is another object of the present invention to provide an audio signal decoding apparatus adapted to the 
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above-mentioned audio signal coding apparatus. 

[001 1 ] Other objects and advantages of the invention will become apparent from the detailed description that follows. 
The detailed description and specific embodiments described are provided only for illustration since various additions 
and modifications within the scope of the invention will be apparent to those of skill in the art from the detailed descrip- 
5 tion. 

[001 2] According to a first aspect of the present invention, there is provided an audio signal coding apparatus receiv- 
ing an audio signal which has been time-to-frequency transformed, and outputting a coded audio signal, and this appa- 
ratus comprises: a first-stage encoder for quantizing the time-to-frequency transformed audio signal; second-and- 
subsequent-stages of encoders each for quantizing a quantization error output from the previous-stage encoder; a 

10 characteristic decision unit for judging the characteristic of the time-to-frequency transformed audio signal, and decid- 
ing the frequency band of the audio signal to be quantized by each of the encoders in the multiple stages; and a coding 
band control unit for receiving the frequency band decided by the characteristic decision unit and the time-to-frequency 
transformed audio signal, deciding the connecting order of the encoders in the multiple stages, and transforming the 
quantization bands of the respective encoders and the connecting order to code sequences. Thereby, the frequency 

15 band to be quantized by each of the multiple encoders and the connecting order of these encoders are decided accord- 
ing to the characteristic of the input audio signal, followed by adaptive scalable coding. Therefore, high-quality and high- 
efficiency adaptive scalable coding is realized. 

[001 3] According to a second aspect of the present invention, in the audio signal coding apparatus of the first aspect 
the encoders comprises: a normalization unit for calculating a normalized coefficient sequence for normalizing the time- 

20 to-frequency transformed audio signal, from the audio signal, quantizing the normalized coefficient sequence by using 
a vector quantization method, and outputting a normalized signal obtained by normalizing the time-to-frequency audio 
signal; and at least one stage vector quantization unit for quantizing the signal normalized by the normalization unit. 
Since each encoder performs at least one stage of vector quantization after normalization of the time-to-frequency 
transformed audio signal, high-quality and high-efficiency adaptive scalable coding is realized. 

25 [001 4] According to a third aspect of the present invention, in the audio signal coding apparatus of the first or second 
aspect, the coding band control unit selects a frequency band having an energy addition sum of quantization error 
larger than a predetermined value, as a frequency band of the audio signal to be quantized by each encoder. Since the 
band having a large energy sum of quantization error is selectively quantized, high-quality and high-efficiency adaptive 
scalable coding is realized. 

30 [001 5) According to a fourth aspect of the present invention, in the audio signal coding apparatus of the first or second * 
aspect, the 'codihg band control unit selects a frequency band having an energy addition sum of quantization error ; 
larger than, a predetermined value, which band is heavily weighted with regard to psychoacoustic characteristics of 
human beings, as a frequency band of the audio signal to be quantized by each encoder. Since the frequency band hav- 
ing an energy addition sum of quantization error which is weighted with psychoacoustic characteristics of human beings 

35 that is larger than a predetermined value is selectively quantized, high-quality and high-efficiency adaptive scalable 
coding is realized. 

[001 61 According to a fifth aspect of the present invention, in the audio signal coding apparatus of the first or second 
aspect, the coding band control unit retrieves, at least once, the whole frequency band of the input audio signal. Since 
the whole frequency band of the input audio signal is quantized at least once, high-quality and high-efficiency adaptive 

40 scalable coding is realized. 

[001 7] According to a sixth aspect of the present invention, in the audio signal coding apparatus of the second aspect, 
the vector quantization unit calculates the quantization error in vector quantization by using a vector quantization 
method with a code book, and outputs the result of the vector quantization as a code sequence. Since the vector quan- 
tization method using the code book is employed in the quantization, high-quality and high-efficiency adaptive scalable 

45 coding is realized. 

[001 8] According to a seventh aspect of the present invention, in the audio signal coding apparatus of the sixth aspect, 
the vector quantization unit uses, for retrieval of on optimum code in the vector quantization, a code vector in which ail 
or part of the codes of the vector is inverted. Since the inverted code vector is employed, high-quality and high-effi- 
ciency adaptive scalable coding is realized. 

so [001 9] According to an eighth aspect of the present invention, in the audio signal coding apparatus of the sixth aspect, 
the vector quantization unit extracts, in calculating distances which are used for retrieving an optimum code in vector 
quantization, a code giving the minimum distance by using the normalized coefficient sequence of the input signal cal- 
culated by the normalization unit as a weight. Since the normalized coefficient sequence of the input signal is used as 
a weight in extracting a code giving the minimum distance when calculating the distances for retvieving the optimum 

55 code, high-quality and high-efficiency adaptive scalable coding is realized. 

[0020] According to a ninth aspect of the present invention, in the audio signal coding apparatus of the sixth aspect, 
the vector quantization unit extracts, in calculating distances which are used for retrieving an optimum code in vector 
quantization, a code giving the minimum distance by using, both of the normalized coefficient sequence calculated by 
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the normalization unit and a value in consideration of psychoacoustic characteristics of human beings as weights. Since 
both of the normalized coefficient sequence calculated by the normalization unit and a value in consideration of psy- 
choacoustic characteristics of human beings are employed as weights in extracting a code giving the minimum distance 
when calculating the distances for retrieving the optimum code, high-quality and high-efficiency adaptive scalable cod- 
5 ing is realized. 

[0021] According to a tenth aspect of the present invention, there is provided an audio signal decoding apparatus for 
decoding a coded audio signal which is output from the audio signal coding apparatus of Claim 1 to output an audio 
signal, said apparatus comprising: an inverse quantization means comprising a single inverse quantizer or multiple- 
stages of inverse quantizers, for reproducing the coefficient sequence of the time-to-frequency transformed audio sig- 

10 nal, from the input audio signal code sequence, on the basis of the quantization bands of the respective encoders of 
each of the multiple stages and the connecting order of these encoders, which are decided by the characteristic deci- 
sion unit and the coding band control unit included in the audio signal coding apparatus; and a frequency-to-time trans- 
formation unit for transforming the output of the inverse quantization means, which is the coefficient sequence of the 
time-to-frequency transformed audio signal, to a signal corresponding to the original audio signal. Therefore, a decod- 

15 ing apparatus capable of decoding the code sequence output from the coding apparatus of the first aspect is realized. 
[0022] According to an eleventh aspect of the present invention, in the audio signal decoding apparatus of the tenth 
aspect, the inverse quantization means comprising a single stage inverse quantizer or each of inverse quantizers of 
multiple stages receives the code sequences output from the encoders of the respective frequency bands of the audio 
signal coding apparatus according to Claim 2, and reproduces the coefficient sequence of the time-to-frequency trans- 

20 formed audio signal from the input audio signal code sequences; said inverse quantization means includes an inverse 
normalization unit for receiving the coefficient sequence of the time-to-frequenpyjtransformed audio signal, which is out- 
put from the inverse quantization means, and the normalized code sequences output from the encoders of the respec- 
tive frequency bands in the audio signal coding apparatus, and obtaining a signal corresponding to the time-to- 
frequency transformed audio signal; and said frequency-to-time transformation unit transforms the output of the inverse 

25 normalization unit to a signal corresponding to the original audio signal. Therefore, a decoding apparatus capable of 
decoding a code sequence output from the coding apparatus of the second aspect is realized. 
[0023] According to a twelfth aspect of the present invention, in the audio signal decoding apparatus of the tenth or 
eleventh aspect, the inverse quantization means performs inverse quantization by using only the codes which are out- 
put from some of the plurality of encoders in the audio signal coding apparatus. In the case where coding is performed 

30 while varying the quantization bands of the encoders and the connecting order thereof in accordance with the charac- 
teristic of the audio signal, it is possible to realize a decoding apparatus which has a simple structure and performs high- 
quality decoding by using only some part of the outputs from the encoders. 

[0024] According to a thirteenth aspect of the present invention, in the audio signal coding apparatus of the first 
aspect, the characteristic decision unit properly selects a band to be quantized in accordance with a signal obtained by 
35 processing the time-to-frequency transformed audio signal input to the characteristic decision unit by a low-pass filter. 
Therefore, it is possible to realize high-quality and high-efficiency adaptive scalable coding in accordance with the char- 
acteristic of the low-pass filter, i.e., in which the low-band is audible. 

[0025] According to a fourteenth aspect of the present invention, in the audio signal coding apparatus of the first 
aspect, the characteristic decision unit properly selects a band to be quantized in accordance with a signal obtained by 
40 subjecting the time-to-frequency transformed audio signal input to the characteristic decision unit to a processing 
including logarithmic calculation. Therefore, it is possible to realize high-quality and high-efficiency adaptive scalable 
coding, in accordance with the processing including the logarithmic calculation, resulting in being adapted to the psy- 
choacoustic characteristics of human beings. 

[0026] According to a fifteenth aspect of the present invention, in the audio signal coding apparatus of the first aspect, 
45 the characteristic decision unit properly selects a band to be quantized, in accordance with a signal obtained by 
processing the time-to-frequency transformed audio signal input to the characteristic decision unit by a high-pass filter. 
Therefore, it is possible to realize high-quality and high- efficiency scalable coding in accordance with the charcteristic 
of the high-pass filter, i.e., in which the high-frequency components are included a lot. 

[0027] According to a sixteenth aspect of the present invention, in the audio signal coding apparatus of the first 
so aspect, the characteristic decision unit properly selects a band to be quantized in accordance with a signal obtained by 
processing the time-to-frequency transformed audio signal input to the characteristic decision unit by a band-pass filter 
or a band-rejection filter. Therefore, it is possible to realize high-quality and high-efficiency adaptive scalable coding in 
accordance with the characteristic of the band-pass filter or the band-rejection filter, i.e., in which only a predetermined 
band is audible or a predetermined band is rejected. 
55 [0028] According to a seventeenth aspect of the present invention, in the audio signal coding apparatus of the first 
aspect, the characteristic decision unit decides the characteristic of the input audio signal, and properly selects a band 
to be quantized by each encoder in accordance with the result of the decision. Since the band to be quantized by each 
encoder is appropriately selected according to the characteristic of the audio signal, high-quality and high-efficiency 



4 



EP 0 942 411 A2 



adaptive scalable coding is realized. 

[0029] According to an eighteenth aspect of the present invention, in the audio signal coding apparatus of the seven- 
teenth aspect, the characteristic decision unit decides the characteristic of the input audio signal and restricts the band 
to be quantized by each encoder in accordance with the result of the decision. Since the band to be quantized by each 
5 encoder is restricted according to the characteristic of the audio signal, high-quality and high-efficiency adaptive scala- 
ble coding is realized. 

[0030] According to a nineteenth aspect of the present invention, in the audio signal coding apparatus of the eight- 
eenth aspect, when the frequency band is divided into a low-band, an intermediate-band, and a high-band and the 
bands to be quantized by the respective encoders are to be restricted, and when the input audio signal has variable 
10 characteristics, the bands to be quantized are controlled so that the high-band is selected more than the other bands. 
Therefore, it is possible to realize high-quality and high-efficiency adaptive scalable coding in which rapidly changing 
high frequency components are included a lot. 

[0031 ] According to a twentieth aspect of the present invention, in the audio signal coding apparatus of the eighteenth 
aspect, when the band is divided into a low-band, an intermediate-band, and a high-band and the high-band is selected 
15 more than the other bands for the bands to be quantized by the respective encoders, the bands to be quantized are con- 
trolled so that most of the bands to be quantized are in the high-band, for a predetermined period from when the high- 
band is selected. Therefore, it is possible to avoid that the state where the high frequency components are included a 
lot is suddenly changed to a different state. 

[0032] According to a twenty-first aspect of the present invention, in the audio signal coding apparatus of the eight- 
20 eenth aspect, the band is divided into a low-band, an intermediate-band and a high-band, and the characteristic of the 
original input audio signal is judged, and the bands to be quantized by the respective encoders are fixed dependent on 
the result of the judgment. Since the bands to be quantized by the respective encoders are f ixed according to the char- 
acteristic of the input audio signal, high-efficiency fixed scalable coding similar to fixed one is realized. 
[0033] According to a twenty-second aspect of the present invention, in the audio signal coding apparatus of the first 
25 aspect, the characteristic decision unit uses one or both of the frequency outline of the time-to-frequency transformed 
audio signal and the normalized coefficient sequence calculated by the normalization unit, as a weight or weights for 
deciding the quantization band of the respective encoders. Since one or both of the frequency outline of the time-to- 
frequency transformed audio signal and the normalized coefficient sequence are used as weights for deciding the 
quantization band of each encoder, high-quality and high-efficiency adaptive scalable coding is realized. 
30 [0034] According to a twenty-third aspect of the present invention, the audio signal coding apparatus of the first aspect 
further comprises; a characteristic decision unit for judging phycho acoustic and physical characteristics of the audio 
signal to be quantized by the respective encoders of each stage; a coding band control unit for controlling the arrang- 
ment of the bands to be quantized by the respective encoders of each stage, in accordance with the coding band 
arrangement information decided by the characteristic decision unit; and the processings by the characteristic decision 
35 unit and the coding band control unit being repeated until predetermined coding condition is satisfied. Since the 
arrangement of the quantization bands of the respective encoders are decided according to the result of decision on 
the phycho acoustic and physical characteristics of the audio signal and the adjustment of the arrangement of the band 
is repeated until the coding condition is satisfied, high-quality and high-efficiency adaptive scalable coding is realized. 
[0035] According to a twenty-fourth aspect of the present invention, in the audio signal coding apparatus of the twenty- 
mo third aspect, the characteristic decision unit comprises: a coding band calculation unit which receives predetermined 
coding condition and calculates coding band information indicating the coding bands of the respective encoders of each 
stage; a psychoacoustic model calculation unit which receives the coding band information, the output of a predeter- 
mined filter which filters one of a frequency-domain audio signal and a difference spectrum, and outputting a psychoa- 
coustic weight representing the phycho acoustic importance in the coding bands of the coding band information; an 
45 arrangement decision unit which receives the psychoacoustic weight and an analysis scale output from an analysis 
scale decision unit, determines the arrangement of the encoders, and outputs the band numbers of the encoders; and 
a coding band arrangement information generation unit which receiving the coding band information and the band num- 
bers, and outputs coding band arrangement information in accordance with the predetermined coding condition. Since 
the arrangement of the coding bands of the respective encoders is decided in consideration of the psychoacoustic 
so weight representing the phycho acoustic importance of human being, high-quality and high-efficiency adaptive scalable 
coding is realized. 

[0036] According to a twenty-fifth aspect of the present invention, the audio signal coding apparatus of the twenty- 
third aspect further comprises: spectrum shift means which receives the time-to-frequency transformed audio signal 
and the coding band arrangement information and shifts the spectrum of the input audio signal to a specified band; an 
55 encoder which encodes the output of the spectrum shifting means, to output a code sequence; a decoding band control 
unit which decodes the code sequence output from the encoder to output a decoded spectrum; difference calculation 
means which calculates a difference between the decoded spectrum and the time-to-frequency transformed audio sig- 
nal; and difference spectrum holding means which holds the current difference information up to the next operation 
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period of the coding band control unit. Thereby, the spectrum of the original audio signal is shifted to a band specified 
by the coding band arrangement information, and a difference between the decoded spectrum which is obtained by the 
shifted spectrum being coded and then decoded and the spectrum of the original audio signal is calculated, and thus 
the shift amount of the spectrum of the original audio signal at present is decided according to this difference in the past, 
whereby the next connecting state of the respective encoders can be controlled so that the quantization error at present 
is reduced, in accordance with the respective differences of the coding obtained by successively shifting the bands to 
be coded, resulting in high-quality and high-efficiency adaptive scalable coding. 

[0037] According to a twenty-sixth aspect of the present invention, in the audio signal coding apparatus of the twenty- 
fifth aspect, the decoding band control unit comprises: a decoder which decodes the code sequence, to output a com- 
posite spectrum; spectrum shift means for shifting the composite spectrum to a specified band, in accordance with the 
coding band arrangement information included in the code sequence; and a decoded spectrum calculation unit which 
holds the current composite spectrum up to the next operation period of the decoding band control unit starts and adds 
the past composite spectrum and the current composite spectrum. Therefore, it is possible to control the arrangement 
of the bands to be quantized by the respective encoders at present and the connecting state of the bands in accordance 
with the arrangement of the bands and the connecting state of the bands in the past, resulting in high-quality and high- 
efficiency adaptive scalable coding. 

[0038] According to a twenty-seventh aspect of the present invention, there is provided an audio signal decoding 
apparatus for decoding a coded audio signal which is output from the audio signal.coding apparatus of Claim 26 to out- 
put on audio signal, which further comprises a decoding band control unit which has the same structure as the decod- 
ing band control unit included in the audio signal coding apparatus. Therefore, it is possible to realize an audio signal 
decoding apparatus capable of decoding a coded signal which is obtained by high-quality and high-efficiency adaptive 
scalable coding in which the arrangement of the bands and the connecting state thereof to be quantized by the respec- 
tive encoders are controlled according to the arrangement of the bands and the connecting state thereof in the past. 
[0039] According to a twenty-eighth aspect of the present invention, there is provided an audio signal coding and 
decoding apparatus comprising the audio signal coding apparatus of Claim 26 and an audio signal decoding apparatus 
for decoding a coded audio signal output from the audio signal coding apparatus to output an audio signal, wherein said 
audio signal decoding apparatus includes a decoding band control unit which has the same structure as the decoding 
band control unit included in the audio signal coding apparatus. Therefore, it is possible to realize an audio signal cod- 
ing and decoding apparatus which comprises an audio signal coding apparatus capable of high-quality and high-effi- 
ciency adaptive scalable coding in which the current arrangement of the bands and the connecting state thereof at 
present are controlled according to the arrangement of. the bands and the connecting state thereof in the past, and an 
audio signal decoding apparatus capable of decoding the output from the coding apparatus. 
[0040] According to a twenty-ninth aspect of the present invention, in the audio signal decoding apparatus of the 
twenty-seventh aspect, the spectrum shift means included in the audio signal coding apparatus receives the spectrum 
to be shifted and the coding band arrangement information, and outputs the coding band information and the shifted 
spectrum. Therefore, high-quality and high-efficiency adaptive scalable coding in which the arrangement of the bands 
to be encoded by the respective encoders and the connecting state thereof at present can be controlled in accordance 
with arrangement of the bands and the connecting state thereof in the past is realized. 

[0041] According to a thirtieth aspect of the present invention, in the audio signal coding apparatus of the twenty- 
fourth aspect, when the input audio signal has rapidly changing characteristicsj.e., the analysis scale is small, said 
arrangement decision unit controls the coding bands of the respective encoders so that the high-band is selected more 
than the other bands. Thereby, even when the characteristic of the input audio signal is one rapidly changing, it is pos- 
sible to perform high-quality and high-efficiency adaptive scalable coding in which high frequency components are 
included a lot in the bands to be encoded. 

[0042] According to a thirty-first aspect of the present invention, in the audio signal coding apparatus of the twenty- 
fourth aspect, when the input audio signal has rapidly changing characteristicsj.e., the analysis scale is small, said 
arrangement decision unit controls the coding bands so that the high-band is selected more than the other bands for a 
predetermined period from when the high-band is selected. Therefore, when the characteristic of the input audio signal 
is one rapidly changing, for a predetermined period from that point of time, it is avoided that the state where the high 
frequency components are included a lot is suddenly changed to a different state, resulting in high-quality and high-effi- 
ciency adaptive scalable coding. 

[0043] According to a thirty-second aspect of the present invention, in the audio signal coding apparatus of the twenty- 
fourth aspect, the coding band calculation unit has a functional relation between the coding band information which is 
the output of the coding band calculation unit and the bit rate or the sampling frequency of the input signal included in 
the input coding condition, which functional relation comprising one of a polynomial function, a logarithmic function, and 
a combination of these functions. Therefore, high-quality and high-efficiency adaptive scalable coding according to the 
coding condition is realized. 

[0044] According to a thirty-third aspect of the present invention, in the audio signal coding apparatus of the thirty- 
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second aspect, when the total number of the encoders is three or more as one of the coding condition, the upper limit 
of the coding band of the third encoder in the order of increasing frequency is at least half of the frequency band of the 
original audio signal Since the apparatus possesses at least three encoders, high-quality and high-efficiency adaptive 
scalable coding is realized. 

5 [0045] According to a thirty-fourth aspect of the present invention, in the audio signal coding apparatus of the thirty- 
second aspect, the coding band calculation unit employs as the function making the functional relation, a function hav- 
ing weighting in consideration of psychoacoustic characteristics of human beings, such as a Bark scale and Mel coef- 
ficients. Therefore, high-quality and high-efficiency adaptive scalable coding in consideration of the psychoacoustic 
characteristics of human beings is realized. 

w [0046] According to a thirty-fifth aspect of the present invention, in the audio signal coding apparatus of the twenty- 
fourth aspect, the arrangement decision unit determines the arrangement of the bands to be coded by the respective 
encoders of each stage; and a plurality of patterns of arrangement of the respective encoders which are prepared in 
advance, are used with switched between these patterns so as to improve the coding efficiency. Therefore, high-quality 
and high-efficiency adaptive scalable coding is realized in a relatively simple structure. 

15 [0047] According to a thirty-sixth aspect of the present invention, in the audio signal coding. apparatus of the twenty- 
fourth aspect, , when the characteristic of the input audio signal is stationary no much rapid change and the analysis 
scale is large, the arrangement decision unit has a small value as the maximum value of the band to be coded by the 
respective encoders of each stage. Therefore, when the input audio signal has stationary characteristic, high-quality 
and high-efficiency adaptive scalable coding, in which the low-band audio signal is audible, is realized. 

20 [0048] According to a thirty-seventh aspect of the present invention, in the audio signal coding apparatus of the 
twenty-fourth aspect, a filter to be connected at a previous stage to the respective encoders is one of a low-pass filter, 
a high-pass filter, a band-pass filter, and a band-rejection filter, or a combination of two or more of these filters. There- 
fore, high-quality and high-efficiency adaptive scalable coding in consideration of to the corresponding band is realized. 
[0049] According to a thirty-eighth aspect of the present invention, in the audio signal decoding apparatus of the 

25 twenty-seventh aspect, the inverse quantization unit performs inverse quantization by using only part of codes which 
are output from the audio signal coding apparatus Therefore, it is possible to realize an audio signal decoding apparatus 
capable of decoding a coded signal output from an audio signal coding apparatus performing high-quaJity and high-effi- 
ciency adaptive scalable coding in a simple constanction. 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

[0050] 

Figure 1 is a block diagram illustrating an audio signal coding apparatus performing adaptive scalable coding, and 
35 a decoding apparatus adapted to the coding apparatus, according to a first embodiment of the present invention. 
Figure 2 is a block diagram illustrating a time-to-frequency transformation unit included in the coding apparatus of 
the first embodiment. 

Figure 3 is a diagram illustrating an encoder included in the coding apparatus of the first embodiment 

Figure 4 is a block diagram illustrating a normalization unit included in the coding apparatus of the first embodiment. 

40 Figure 5 is a frequency outline normalization unit in the coding apparatus of the first embodiment. 

Figure 6 is a block diagram illustrating a characteristic decision unit in the coding apparatus of the first embodiment. 
Figure 7 is a block diagram illustrating a coding band control unit in the coding apparatus of the first embodiment 
Figure 8 is a block diagram illustrating a quantization unit in the coding apparatus of the first embodiment 
Figure 9 is a block diagram illustrating a decoder included in the decoding apparatus of the first embodiment. 

45 Figure 10 is a diagram for explaining the outline of general Twin VQ. 

Figure 1 1 is a diagram for explaining general Twin VQ scalable coding. 

Figure 12 is a diagram for explaining the disadvantage of general fixed scalable coding. 

Figure 13 is a diagram for explaining the advantage of generate adaptive scalable coding. 

Figure 14 is a block diagram illustrating an audio signal coding apparatus performing adaptive scalable coding, and 

so a decoding apparatus adapted to the coding apparatus, according to a second embodiment of the present inven- 
tion. 

Figure 15 is a block diagram illustrating an encoder included in the coding apparatus of the second embodiment. 
Figure 1 6 is a block diagram illustrating a characteristic decision unit in the coding apparatus of the second embod- 
iment. 

55 Figure 17 is a block diagram illustrating a coding band control unit in the coding apparatus of the second embodi- 
ment. 

Figure 18 is a block diagram illustrating a decoder included in the coding apparatus of the second embodiment. 
Figure 19 is a block diagram illustrating a decoding band control unit in the coding apparatus of the second embod- 
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iment. 

Figure 20 is a block diagram illustrating a spectrum shift means in the coding apparatus of the second embodiment. 
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 

[0051 ] Hereinafter, a first embodiment of the present invention will be described with reference to figures 1 to 9, and 
a second embodiment of the present invention will be described with reference to figures 14 to 20. 

[Embodiment 1] 

10 

[0052J Figure 1 is a block diagram illustrating an audio signal coding apparatus 1 performing adaptive scalable coding 
according to a first embodiment of the present invention. 

[0053] In figure 1, reference numeral 1001 denotes a coding apparatus for coding an original audio, signal 501. In the 
coding apparatus 1001, numeral 502 denotes an analysis scale decision unit which decides an analysis scale 504 for 

15 analyzing the original audio signal 501 ; numeral 503 denotes a time-to-frequency transformation unit which transforms 
the time axis of the original audio signal 501 to the frequency axis in units of the analysis scales 504; numeral 504 
denotes the analysis scale decided by the analysis scale decision unit 502; numeral 505 denotes the spectrum of the 
original audio signal; numeral 701 denotes a filter to which the spectrum 505 of the original audio signal is input; 
numeral 506 designates a characteristic decision unit which decides the characteristic of the spectrum 505 of the orig- 

20 inal audio signal to decide the frequency band of the audio signals to be quantized by multiple-stages of encoders 511, 
512, 513, 51 1b, ... included in the coding apparatus 1001 ; numeral 507 designates a coding band control unit which 
receives the frequency bands of the respective encoders decided by the characteristic decision unit 506, and the time- 
to-frequency transformed audio signal, decides the connecting order of the multiple-stages of encoders 511,512,513, 
514, 511b, .... and transforms the quantization bands of the respective encoders and the connecting order to code 

25 sequences; numeral 508 denotes a band control code sequence as the code sequence output from the coding band 
control unit 507; numeral 510 denotes an analysis scale code length which is a code sequence of the analysis scale 
output from the analysis scale decision unit 502; numerals 51 1, 512, and 513 denote a low-band encoder, an interme- 
diate-band encoder, and a high-band encoder for coding signals in low-band, intermediate-band, and high-band, 
respectively; numeral 51 1b denotes a second-stage low-band encoder for coding a quantization error 518 of the first- 

30 stage low-band enccder.;511;. numerals 521, 522 and 523 denote a low-band code sequence, an intermediate-band 
. code sequence, and a high-band code sequence as coded signals output from the encoders 51 1 , 51 2 and 51 3, respec- 
tively; numeral 521b denotes a second-stage low-band code sequence which is the output from the second-stage low- 
band encoder 511b; numerals 51 8, 51 9 and 520 denote quantization differences corresponding to differences between 
signals which have not yet been coded and signals which have already been coded, respectively output from the encod- 

35 ers 51 1 , 512 and 513; and numeral 518b denotes a second-stage quantization error output from the second-stage low- 
band encoder 51 1b. 

[0054] On the other hand, reference numeral 1 002 denotes a decoding apparatus for decoding the code sequences 
obtained in the coding apparatus 1001 . In the decoding apparatus 1002, numeral 5 denotes a frequency-to-time trans- 
formation unit which performs inverse transformation of that of the time-to-frequency transformation unit 503; numeral 

40 6 denotes a window multiplication unit which multiplies an input by a window function on the time axis; numeral 7 
denotes a frame overlapping unit; numeral 8 denotes a coded signal; numeral 9 denotes a band composition unit; 
numeral 1201 denotes a decoding band control unit; numerals 1202, 1203 and 1204 denote a low-band decoder, an 
intermediate-band decoder, and a high-band decoder which perform decoding adaptively to the low-band encoder 51 1 , 
the intermediate-band encoder 512, and the high-band encoder 513, respectively; and numeral 1202b denotes a sec- 

45 ond-stage low-band decoder which decades the output of the first-stage low-band decoder 1 202. 

[0055] In the above-described structure, the encoders (decoders) subsequent to the first-stage encoder (decoder) 
may be arranged for more bands or in more stages other than mentioned above. As the number of the stages of encod- 
ers (decoders) increases, the accuracy of coding (decoding) is improved as desired. 
[0056] A description is now given of the operation of the coding apparatus 1 001 . 

so [0057] It is assumed that an original audio signal 501 to be coded is a digital signal sequence which is temporally 
continuous. For example, it is a digital signal obtained by quantizing an audio signal to 16 bits at a sampling frequency 
of 48kHz. 

[0058] The original audio signal 501 is input to the analysis scale decision unit 502. The analysis scale decision unit 
502 investigates the characteristics of the original audio signal to decide the analysis scale 504, and the result is sent 
55 to the decoding apparatus 1002 as the analysis scale code sequence 510. For example, 256, 1024, or 4096 is used as 
the analysis scale 504. When the high-frequency component included in the original audio signal 501 exceeds a pre- 
determined value, the analysis scale 504 is decided to be 256. When the low-frequency component exceeds a prede- 
termined value and the high-frequency component is smaller than a predetermined value, the analysis scale 504 is 



8 



EP 0 942 411 A2 



10 



15 



20 



decided to be 4096. In the cases other than mentioned above, the analysis scale 504 is decided to be 1024. According 
to the analysis scale 504 so decided, the time-to-frequency transformation unit 503 calculates a spectrum 505 of the 
original audio signal 501. 

[0059] Figure 2 is a block diagram illustrating the time-to-frequency transformation unit 503 in more detail. 
[0060] The original audio signal 501 is accumulated in a frame division unit 201 until reaching a predetermined sam- 
ple number. When the number of accumulated samples reaches the analysis scale 504 decided by the analysis scale 
decision unit 502, the frame division unit 201 outputs the samples. Further, the frame division unit 201 outputs the sam- 
ples for every shift length which has previously been specified. For example, in the case where the analysis scale 504 
is 4096 samples, when the shift length is set at half the analysis scale 504, the frame division unit 201 outputs latest 
4096 samples every time the analysis scale 504 reaches 2048 samples. Of course, even when the analysis scale 504 
or the sampling frequency varies, the shift length can be set at half the analysis scale 504. 
[0061] The output from the frame division unit 201 is input to a window multiplication unit 202 in the subsequent stage. 
In the window multiplication unit 202, the output from the frame division unit 201 is multiplied by a window function on 
time axis, and the result is output from the window multiplication unit 102. This operation is expressed by formula (1). 

hxi=h f *x f /'=:1,2,A,/V (1) 
/7 / = sin|^(/ + 0.5)j 



where Xj is the output from the frame division unit 201 , hj is the window function, and hxi is the output from the window 
multiplication unit 202. Further, i is a suffix for time. The window function hi shown in formula (1) is merely an example, 

25 and the window function is not restricted to that of formula (1 ). 

[0062] Selection of the window function depends on the feature of the signal input to the window multiplication unit 
202, the analysis scale 504 of the frame division unit 201 . and the shapes of window functions in frames which are posi- 
tioned temporally before and after the frame being processed. For example, the window function is selected as follows. 
When assuming that the analysis scale 504 of the frame division unit 201 is N, the feature of the signal input to the win- 

30 dow multiplication unit 202 is such that the average power of signals which is calculated at every N/4 varies significantly, 
the analysis scale 504 is made smaller than N, followed by the operation of formula (1). Further, it is desirable that the 
window function is appropriately selected in accordance with the. shape of the window function of a frame in the past 
and the shape of the window function of a frame in the future, so that the shape of the window function of the present 
frame is not distorted. 

35 [0063] Next, the output from the window multiplication unit 202 is input to an MDCT unit 203, wherein the output is 
subjected to modified discrete cosine transform (MDCT) to output MDCT coefficients. The modified discrete cosine 
transform is generally represented by formula (2). 



40 



AM 



™ \2n(k + V£)(/7 + n 0 )) 

z te »'H — jf — - (2) 



n 0="+| (*=0,1.A,£-1) 

45 

[0064] Assuming that the MDCT coefficients output from the MDCT unit 203 are represented by y k in formula (2), 
those MDCT coefficients present the frequency characteristics, and the frequency characteristics linearly correspond 
to lower frequency components as the variable k of y k approaches closer to 0, and correspond to higher frequency corn- 
so ponents as the variable k approaches closer to N/2-1 , increasing from 0. The MDCT coefficients so calculated are rep- 
resented by the spectrum 505 of the original audio signal. 

[0065] Next, the spectrum 505 of the original audio signal is input to a filter 701 . Assuming that the input to the filter 
701 is x 701 (i) and the output Of the filter 701 is y 701 (i). the filter 701 is expressed by formula (3). 

55 y 7 oi(0 88 "70l(') * (*70l(') + *70l(' + 1 » (3) 

/ = 0,1.A , fe -2 
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wherein fs is the analysis scale 504. 

[0066] The filter 701 expressed by formula (3) is a kind of moving average filter. However, the filter 70 1 is not restricted 

to such moving average filter. Other filters, such as a high-pass filter or a band-rejection filter, may be used. 

[0067] The output of the filter 701 and the analysis scale 504 calculated in the analysis scale decision unit 502 are 

5 input to a characteristic decision unit 506. Figure 6 shows the characteristic decision unit 506 in detail. In the charac- 
teristic decision unit 506. acoustic and physical characteristics of the original audio signal 501 and those of the spec- 
trum 505 of the original audio signal 501 are decided. The acoustic and physical characteristics of the original audio 
signal 501 and those of the spectrum 505 are, for example, a distinction between voice and music. In case of voice, the 
greater part of frequency components are included in bands lower than 6kHz, for example. 

10 [0068] Next, the operation of the characteristic decision unit 506 will be described with reference to figure 6. 

[0069] Assuming that a signal obtained by filtering the spectrum 505 of the original audio signal which is input to the 
characteristic decision unit 506 by the filter 701 is x 50 6(i). a spectrum power Pso6(i) is calculated from x^i) according 
to formula (4), in a spectrum power calculation unit 803. 



[0070] The spectrum power P506O) is used as one of inputs to a coding band control unit 507 described later and used 
as a band control weight 517. 

20 [0071 ] When the analysis scale 504 is small (for example, 256), arrangement of the respective encoders is decided 
by an arrangement decision unit 804 such that the respective encoders are fixedly placed, and coding band arrange- 
ment information 516 indicating "fixed arrangement" is sent to a coding band control unit 507. 
[0072] When the analysis scale 504 is not small (for example, 4096 or 1 024), arrangement of the respective encoders 
is decided by the arrangement decision unit 804 such that the respective encoders are dynamically placed, and coding 

25 band arrangement information 51 6 indicating "dynamic arrangement" is sent to the coding band control unit 507. 
[0073] Next, the operation of the coding band control unit 507 will be described with reference to figure 7. 
[0074] The coding band control unit 507 receives the band control weight 517 output from the characteristic decision 
unit 506, the coding band arrangement information 516, the signal obtained by filtering the spectrum 505 of the original 
audio signal by using the filter 701, and the quantization error 518, 519, or 520 output from the encoder 511, 512, or 

30 513. However, the coding band controlunit 507 receives these inputs because the respective encoders 51 1 , 512, 513, 
51 1b, ... and the coding band control unit 507 operate recursively. So, during the first-time operation of the coding band 
control unit 507, since no quantization, error exists, the three inputs other than the quantization error are input to the 
coding band control unit 507. 

[0075] When the analysis scale 504 is small and the coding band arrangement information 516 indicates "fixed 
35 arrangement", the quantization bands of encoders, the number of encoders, and the connecting order are decided by 
a quantization order decision unit 902, an encoder number decision unit 903, and a band width calculation unit 901 , so 
that coding is executed in the order of low-band, intermediate-band, and high-band, according to fixed arrangement 
which has been defined in advance, followed by coding to generate a band control code sequence 508. In the band con- 
trol code sequence 508, the band information, the number of encoders, and the connecting order of encoders are 
40 encoded as information. 

[0076] For example, encoders are arranged such that the coding bands of the respective encoders and the number 
of the encoders are selected as follows: one encoder in 0Hz~4kHz, one encoder in 0Hz~8kHz, one encoder in 
4kHz~12kHz, two encoders in 8kHz~16kHz, and three encoders in 16kHz-24kHz, followed by coding. 
[0077] When the coding band arrangement information 51 6 indicates "dynamic arrangement", the coding band con- 

45 trol unit 507 operates as follows. 

[0078] As shown in figure 7, the coding band control unit 507 comprises a band width calculation unit 901 which 
decides the quantization band widths of the respective encoders, a quantization order decision unit 902 which decides 
the quantization order of the respective encoders, and an encoder number decision unit 903 which decides the number 
of encoders in each band. That is, the band widths of the respective encoders are decided according to the signals input 

50 to the coding band control unit 507. In each of predetermined bands (for example, 0Hz~4kHz, 0Hz~8kHz, 
4kHz~12kHz, 8kHz~16kHz, and 16kHz~24kHz), the average of the results obtained by multiplying the band control 
weight 51 7 and the quantization error after coding of each encoder, is calculated. Assuming that the band control weight 
517 is weight 517 (i), and the quantization error is err^), the average is calculated in formula (5). 



15 
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wherein j is an index for band, Ave^G) is the average for band j, f upper G) and ^ QT Q) are the upper-limit frequency and 
the lower-limit frequency for band j, respectively Then, j at which the average Avegoiti) amounts to maximum is 
retrieved, and this j is the band to be coded by the encoder. Further, the retrieved j is sent to the encoder number deci- 
sion unit 903 to increase the number of encoders in the band corresponding to j by one, and the number of encoders 
existing in the coding band is continued to be stored. During then, coding is repeated until the total sum of the stored 
encoder numbers reaches the overall sum of encoders which has been decided in advance. Finally, the bands of the 
encoders and the number of encoders for respective bands are transmitted to the decoder, as a band control code 
sequence 508. 

[0079] Next, the operation of an encoder 3 will be described with reference to figure 3. 
[0080] The encoder 3 comprises a normalization unit 301 and a quantization unit 302. 

[0081 ] The normalization unit 301 receives both of the signal on time-axis which is output from the frame division unit 
201 and the MDCT coefficients which are output from the MDCT unit 203, and normalizes the MDCT coefficients by 
using some parameters. To normalize the MDGT coefficients means to suppress variations in values of the MDCT coef- 
ficients, which values are considerably different between the low-band components and the high-band components. For 
example, when the low-band component is extremely larger than the high-band component, a parameter which has a 
larger value in the low-band component and a smaller value in the high-band component is selected to divide the MDCT 
coefficients, thereby resulting in the MDCT coefficients with suppressed variations. Further, in the normalization unit 
301 , indices expressing the parameters used for the normalization are coded as a normalized code sequence 303. 
[0082] The quantization unit 302 receives the MDCT coefficients normalized by the normalization unit 301 as inputs, 
and quantizes the MDCT coefficients. At this time, the quantization unit 302 outputs a code index having the smallest 
difference among the differences between the quantized values and the respective quantized outputs corresponding to 
plural code indices included in a code book In this case, a difference between the value quantized by the quantization 
unit 302 and the value corresponding to the code index output from the quantization unit 203 is a quantization error. 
[0083] Next, the normalization unit 301 will be described in more detail by using figure 4. 
[0084] In figure 4, reference numeral 401 denotes a frequency outline normalization unit which receives the output of 
the frame division unit 201 and the output of the MDCT unit 203, and numeral 402 denotes a band amplitude normali- 
zation unit which receives the output of the frequency outline normalization unit 401 and performs normalization with 
reference to a band table 403. : 

[0085] A description is given of the operation of the normalization unit 301 . 

[0086] : The frequency outline normalization unit 401 calculates a frequency outline, i.e., a rough shape of frequency, 
by using the time-axis data output from the frame division unit 201 , and divides the MDCT coefficients output from the 
MDCT unit 203. Parameters used for expressing the frequency outline are coded as a normalized code sequence 303. 
The band amplitude normalization unit 402 receives the output signal from the frequency outline normalization unit 401 , 
and performs normalization for every band shown in the band table 403. For example, assuming that the MDCT coeffi- 
cients output from the frequency outline normalization unit 401 are dct(i) (i=0~2047) and the band table 403 is shown 
by [Table 1], the average of amplitudes in each band is calculated according to formula (6). 



where bjlow and bjhigh are the lowest-band index i and the highest-band index i, respectively, in which dct(i) in the j-th 
band shown in the band table 203 belongs. Further, p is the norm in distance calculation, and p is desired to be 2. Fur- 
ther, avej is the average of amplitudes in each band j. The band amplitude normalization unit 402 quantizes avej to 
obtain qavej, and normalizes it according to formula (7). 



bjhigh 



sum j = £ dct(i) p 



(6) 



i^bjlow 




bjlowztebjhigh 



n_dct{i) = dct{i)/qavej 



bjlowz&bjhigh 



(7) 



[0087] To quantize avej, scalar quantization may be employed, or 
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[Table 1] 
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[Table 1] (continued) 
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vector quantization may be carried out by using the code book. The band amplitude normalization unit 402 codes the 
indices of parameters used to express qave,, as a normalized ; code sequence 303. 

[0088] Although the normalization unit 301 in the encoder comprises both of the frequency outline normalization unit 
30 401 and the band amplitude normalization unit 402 as shown in figure 4, it may comprise only one of these units 401 
and 402. Further, when there is no significant variations between the low-band components and the high-band compo- 
nents of the MDCT coefficients output from the MDCT unit 203, the output from the MDCT unit 203 may be directly input 
to the quantization unit 302 without using the units 401 and 402. 

[0089] The frequency outline normalization unit 401 shown in figure 4 will be described in more detail by using figure 
35 5. In figure 5, reference numeral 601 denotes a linear prediction analysis unit which receives the output from the frame 
division unit 201 , numeral 602 denotes an outline quantization unit which receives the output from the linear prediction 
analysis unit 601, and numeral 603 denotes an envelope characteristic normalization unit which receives the output 
from the MDCT unit 203. 

[0090] Next, the operation Qf the frequency outline normalization unit 401 will be described with reference to figure 5. 

40 [0091] The linear prediction analysis unit 601 receives the time-axis audio signal output from the frame division unit 
201 , and subjects the signal to linear predictive coding (LPC). Generally, linear prediction coefficients (LPC coefficients) 
can be obtained by such as calculating an autocorrelation function of the signal which is window-multiplied by such as 
Humming window and solving a normalization equation. The LPC coefficients so calculated are transformed to line 
spectral pair coefficients (LSP coefficients) or the like to be quantized by the outline quantization unit 602. As a quarrti- 

45 zation method, vector quantization or scalar quantization may be employed. Then, frequency transfer characteristics 
expressed by the parameters quantized by the outline quantization unit 602 are calculated by the envelope character- 
istic normalization unit 603, and the MDCT coefficients output from the MDCT unit 203 are divided by the frequency 
transfer characteristics, thereby normalizing the MDCT coefficients. To be specific, assuming that the LPC coefficients 
equivalent to the parameters quantized by the outline quantization unit 602 are qlpcfi), the frequency transfer charac- 

so teristics calculated by the envelope characteristic normalization unit 603 can be expressed by formula (8). 
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where ORDER is desired to be 10-40. and ftt( ) means high-speed Fourier transformation. By using the frequency 
transfer characteristics env(i) so calculated, the envelope characteristic normalization unit 603 performs envelope char- 
acteristic normalization according to formula (9). 
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30 



where mdct(i) is the output signal from the MDCT unit 203, and fdct(i) is the normalized output signal from the envelope 
characteristic normalization unit 603. - - 

[0092] Next, the operation of the quantization unit 302 included in the encoder 1 will be described in detail by using 
figure 8. 

[0093] Initially, some of the MDCT coefficients 1001 input to the quantization unit 302 are extracted to constitute a 
sound source sub-vector 1003. Assuming that coefficient sequences, which are obtained by dividing the MDCT coeffi- 
cients input to the normalization unit 301 with the MDCT coefficients output from the normalization unit 301, are nor- 
malized components 1002, a sub^ector is extracted from the; normalized components 1002 in accordance with the 
same rule as that for extracting the sound source sub-vector 1003 from the MDCT coefficients 1 001 , thereby providing 
a weight sub-vector 1004. The rule for extracting the sound source sub-vector 1003 (the weight sub-vector 1004) from 
the MDCT coefficients 1001 (the normalized components 1002) is represented by formula (10). 
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where subvectorj(j) is the j-th element of the i-th sound source sub-vector, vector ( ) is the MDCT coefficients 1001 , 
TOTAL is the total element number ( of the MDCT coefficients 1001, CR is the element number of the sound source sub- 
vector 1003, and VTOTAL is a value equal to or larger than TOTAL, which value is set so that VTOTAL/CR takes an inte- 
ger. For example, when TOTAL is 2048, CR is 19 and VTOTAL is 2052, or CR is 23 and VTOTAL is 2070, or CR is 21 
and VTOTAL is 2079. The weight sub-vectors 1004 can be extracted according to the procedure of formula (10). 
[0094] The vector quantizer 1005 searches the code vectors in the code book 1009 for a code vector having the short- 
est distance from the sound source sub-vector 1003, after being weighted by the weight sub-vector 1004. The vector 
quantizer 1005 outputs the index of the code vector having the shortest distance, and a residual sub-vector 1010 which 
corresponds to a quantization error between the code vector having the shortest distance and the input sound source 
sub-vector 1003. 

[0095] An example of practical calculation procedure will be described on the premise that the vector quantizer 1005 
is composed of a distance calculation means 1006, a code decision means 1007, and a residual generation means 
1008. 

[0096] The distance calculation means 1006 calculates the distance between the i-th sound source sub-vector 1003 
and the k-th code vector in the code book 1009 by using formula (11). 
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« = Z w y "isubvectorM-CM* (1 1) 

where Wj is the j-th element of the weight sub-vector, CkQ) is the j-th element of the k-th code vector, and R and S are 
norms for distance calculation. The values of R and S are desired to be 1 , 1 .5, 2. These norms R and S may have dif- 
ferent values. Further, dik is the distance of the k-th code vector from the i-th sound source sub-vector. The code deci- 
sion means 1007 selects a code vector which has the shortest distance among the distances calculated by formula 
(1 1), and encodes the index of the selected code vector as a code sequence 304. For example, when diu is the smallest 
value among a plurality of dik, the index to be encoded with respect to the i-th sub-vector is u. The residual generation 
means 1008 generates the residua! sub-vector 1010 by using the code vector selected by the code decision means 
1007, according to formula (12). 

res,(y) = subvector i (j)-C u U) (12) 



wherein resj(j) is the j-th element of the i-th residual sub-vector 1010, and C u (j) is the j-th element of the code vector 
selected by the code decision means 1 007. Then, an arithmetic operation which is reverse to that of formula (1 0) is car- 
ried out by using the residual sub-vector 101 to obtain a vector, and a difference between this vector and the vector 

20 which has been the original target of coding by this encoder is retained as MDCT coefficients to be quantized in the sub- 
sequent encoders. However, when coding of some band does not influence on the subsequent encoders, i.e., when the 
subsequent encoders do not perform coding, it is not necessary for the residual generation means 1 008 to generate the 
residual sub-vector 1 01 0 and the M DCT coefficients 1011. Although the number of code vectors possessed by the code 
book 1 009 is not specified, it is preferably about 64 when the memory capacity and the calculation time are considered. 

25 [0097] As another example of the vector quantizer 1005, the following structure is available. That is, the distance cal- 
culation means 1006 calculates the distance by using formula (13). 



dik- 



^'(subvectodfi-CMY k<K 
^'{subvectorM-C^ijf kzK '"^ 



wherein K is the total number of code vectors used for code retrieval on the code book 1009. 
[0098] The code decision means 1007 selects k which gives the minimum value of the distance dik calculated in for- 
mula (13), and encodes the index thereof. Here, k takes any value from 0 to 2K-1 . The residual generation means 1008 
40 generates a residual sub-vector 1010 by using formula (14). 

, . (subvector, (j) - C. {j) Q*k<K 
r€SAjh LbvectorXi) * C.0) Ksk<2K 

45 v 



[0099] Although the number of code vectors possessed by the code book 1009 is not restricted, it is preferably about 
so 64 when the memory capacity and the calculation time are considered. 

[0100] Further, although the weight sub-vector 1004 is generated from the normalized components 1002 in the above- 
described structure, it is possible to generate a weight sub-vector by multiplying the weight sub-vector 1004 with a 
weight regarding the acoustic characteristics of human beings. 

[0101 ] As described above, the band widths, number of encoders for each band, and connecting order of the encod- 
55 ers are dynamically decided. Quantization is carried out according to the information of the respective encoders so 
decided. 

[0102] On the other hand, the decoding apparatus 2 performs decoding by using the normalized code sequences 
which are output from the encoders in the respective bands, the code sequences which are from the quantization units 
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corresponding to the normalized code sequences, the band control code sequences which are output from the coding 
band control unit, and the analysis scale code sequences which are output from the analysis scale decision unit. 
[01 03] Figure 9 shows the structure of the decoders 1 202, 1 203, or the like. Each decoder comprises an inverse quan- 
tization unit 1101 which reproduces normalized MDCT coefficients, and an inverse normalization unit 1102 which 
5 decodes normalization coefficients (parameters used for normalization) and multiplies the reproduced normalized 
MDCT coeff idents by the normalization coefficients. 

[0104] To be specific, in the inverse normalization unit 1 102, parameters used for normalization in the coding appa- 
ratus 1 are reproduced from the normalized code sequence 303 output from the normalization unit in the encoding 
apparatus 1, and the output of the inverse quantization unit 1101 is multiplied by the parameters to reproduce the 
10 MDCT coeff idents. 

[0105] In the decoding band control unit 1201 , information relating to the arrangement and number of the encoders 
used in the coding apparatus is reproduced by using the band control code sequence 508 which is output from the cod- 
ing band control unit 507, and decoders are disposed in the respective bands, according to the information. Then, 
MDCT coefficients are obtained by a band composition unit 9 which arranges the bands in the reverse order of the cod- 
15 ing order of the respective encoders in the coding apparatus. The MDCT coefficients so obtained are input to a fre- 
quency-to-time transformation unit 5, wherein the MDCT coefficients are subjected to inverse MDCT to reproduce the 
time-domain signal from the frequency-domain signal. The inverse MDCT is represented by formula (15). 
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. where yy k is the MDCT coefficients reproduced in the band composition unit 9, and xx(n) is the inverse MDCT coeffi- 

v*. cients which are output from the frequency-to-time transformation unit 5. 

[0106] The window multiplication unit 6 performs window multiplication by using the output xx(i) from the frequency- 

30 to-time transformation unit 5. This window multiplication is performed according to formula (16) by.usingthe same win- 
dow as that used by the time-to-frequency transformation unit 503 of the coding apparatus 1 . 



z(0-*r(0Vi, " (16) 

where z(i) is the output of the window multiplication unit 6. 

[0107] The frame overlapping unit 7 reproduces the audio signal by using the output from the window multiplication 
unit 6. Since the output from the window multiplication unit 6 is a temporally overlapped signal, the frame overlapping 
unit 7 generates an output signal 8 of the decoding apparatus 2, by using formula (17). 

out m (i) = z m (/)+z m . 1 (/+SH/FT) (17) 



wherein z m (i) is the i-th output signal z(i) of the window multiplication unit 6 in the m-th time frame, is the i-th out- 
45 put signal of the window multiplication unit 6 in the (m-1)th time frame, SHIFT is the sample number corresponding to 
the analysis scale of the coding apparatus, and out m (i) is the output signal of the decoding apparatus 2 in the m-th time 
frame of the frame overlapping unit 7. 

[0108] In this first embodiment, the quantizable frequency range calculated by the band width calculation unit 901 
included in the coding band control unit 507 may be restricted by the analysis scale 504 as described hereinafter. 

so [0109] For example, when the analysis scale 504 is 256, the lower and upper limits of the quantizable frequency range 
of each encoder are set at about 4kHz and 24kHz, respectively. When the analysis scale 504 is 1024 or 2048, the 
above-mentioned lower and upper limits are set at 0Hz and about 16kHz, respectively. Further, once the analysis scale 
504 has become 256, for a predetermined period after that (e.g., about 20msec), the quantizable frequency range of 
each quantizer and the arrangement of the quantizers may be fixed under the control of the quantization order decision 

55 unit 902. Thereby, the arrangement of the quantizers is fixed timewise, and occurrence of acoustic egress and ingress 
of voice bands (i.e., acoustic sense such that a voice which has mainly been in a high band changes, in a moment, to 
a voice in a low band) is suppressed. 

[01 1 0] As described above, the audio signal coding apparatus according to the first embodiment is provided with the 
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characteristic judgement unit which decides the frequency band of an audio signal to be quantized by each encoder of 
multiple-stage encoders; and the coding band control unit which receives the frequency band decided by the charac- 
teristic decision unit and the time-to-frequency transformed original audio signal, decides the order of connecting the 
respective encoders, and transforms the quantization bands of the encoders and the connecting order to code 
5 sequences, thereby implementing adaptive scalable coding. Therefore, it is possible to provide an audio signal coding 
apparatus which performs high quality and high efficiency adaptive scalable coding with sufficient performance for var- 
ious audio signals, and a decoding apparatus which can decode the coded audio signals. 

[Embodiment 2] 

10 

[01 1 1 ] Hereinafter, a second embodiment of the present invention will be described by using figures 1 4 to 20. 
[0112] Figure 14 is a block diagram illustrating a coding apparatus 2001 performing adaptive scalable coding, and a 
decoding apparatus 2002 adapted to the coding apparatus 2001 , according to the second embodiment of the present 
invention. In the coding apparatus 2001 , reference numeral 2001 05 denotes coding conditions, such as the number of 

15 encoders, the bit rate, the sampling frequency of an input audio signal, and the coding band information of each 
encoder; numeral 2001 07 denotes a characteristic decision unit which decides the frequency bands of audio signals to 
be quantized by multiple-stages of encoders; numeral 200109 denotes coding band arrangement information; numeral 
200110 denotes a coding band control unit which receives the frequency bands decided by the characteristic decision 
unit 200107 and the time-to-frequency transformed audio signal, and transforms the quantization bands of the respec- 

20 tive encoders and the connecting order of the encoders to a code sequence 2001 1 1 ; and numeral 2001 12 denotes a 
transmission code sequence composition unit. Further, in the decoding-apparatus 2002, reference numeral 200150 
denotes a transmission code sequence decomposition unit; numeral 200151 denotes a code sequence; numeral 
200153b denotes a decoding band control unit which receives the code sequence 200151 and controls the decoding 
bands of decoders for decoding the code sequence 200151 ; and numeral 200154b denotes a decoded spectrum. The 

25 coding apparatus 2001 of this second embodiment performs adaptive scalable coding, like the coding apparatus 1001 
of the first embodiment. However, the coding apparatus 2001 is different from the coding apparatus 1 001 in the follow- 
ing points. The coding band control unit 200110 in the coding apparatus 2001 includes a decoding band control unit 
200153, and the decoding apparatus 2002 includes a decoding band control unit 200153b identical to the decoding 
band control unit 200153. Furthermore, the spectrum power calculation unit 803 in the characteristic decision unit 506 

30 of the first embodiment is replaced with a psychoacoustic model calculation unit 200602. Moreover, the characteristic 
decision unit 200107 includes a coding band arrangement information generation means 200604 which generates cod- 
ing band arrangement information 200109 in accordance with the coding conditions 200105, the coding band informa- 
tion 200702 output from the coding band calculation unit 200601, and the band number 200606 output from the 
arrangement decision unit 200603. 

35 [01 1 3] Next, the operation of the coding apparatus 2001 will be described. 

[0114] It is assumed that an original audio signal 501 to be coded by the coding apparatus 2001 is a digital signal 
sequence which is temporally continuous. 

[01 15] Initially, the spectrum 505 of the original audio signal 501 is obtained by the same process as described for the 
first embodiment. In this second embodiment, the coding conditions 200105 including the number of encoders, the bit 

40 rate, the sampling frequency of the input audio signal, and the coding band information of the respective encoders, are 
input to the characteristic decision unit 200107 of the coding apparatus 2001. The characteristic decision unit 200107 
outputs the coding band arrangement information 200109 including the quantization bands of the respective encoders 
and the connecting order thereof, to the coding band control unit 2001 1 0. The coding band control unit 2001 1 0 receives 
the coding band arrangement information 200109 and the spectrum 505 of the original audio signal, and performs 

45 encoding on the basis of these inputs by encoders under control by the control unit 2001 1 0, thereby providing the code 
sequence 2001 1 1 . The code sequence 2001 1 1 is input to the transmission code sequence composition unit 2001 1 2 to 
be composited, and the composite output is sent to the decoding apparatus 2002. 

[0116] In the decoding apparatus 2002, the output of the transmission code sequence composition unit 2001 is 
received by the transmitted code sequence decomposition unit 200150 to be decomposed to the code sequence 

so 200151 and the analysis scale code sequence 200152. The code sequence 200151 is input to the decoding band con- 
trol unit 200153, and decoded by decoders under control by the control unit 200153, thereby providing the decoded 
spectrum 200154. Then, based on the decoded spectrum 200152 and the analysis scale code sequence 200152, the 
decoded signal 8 is obtained by using the frequency-to-time transformation unit 5, the window multiplication unit 6, and 
the frame overlapping unit 7. 

55 [0117] Next, the operation of the characteristic decision unit 200107 will be described by using figure 16. 

[01 1 8] The characteristic decision unit 2001 07 comprises the coding band calculation unit 200601 which calculates 
the coding band arrangement information 200702 by using the coding conditions 200105; the psychoacoustic model 
calculation unit 200602 which calculates a psychoacoustic weight 200605, based on psychoacoustic characteristics of 
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human beings, from the spectrum information such as the spectrum 505 of the original audio signal or the difference 
spectrum 200108, and the coding band information 200702; the arrangement decision unit 200603 which with weight- 
ing on the psychoacoustic weight 200605 with reference to the analysis scale 503 decides the arrangement of the 
bands of the respective encoders, and outputs the band number 200606; and the coding band arrangement information 
5 generation unit 200604 which generates the coding band arrangement information 200109, from the coding conditions 
200105, the coding band information 200702 output from the coding band calculation unit 200601, and the band 
number 200606 output from the arrangement decision unit 200603. 

[01 1 9] The coding band calculation unit 200601 calculates the upper limit fpu(k) and the lower limit fpl(k) of the coding 
band which is to be coded by the encoder 2003 shown in figure 15 by using the coding condition 200105 which has 
10 been set before the coding apparatus 2001 starts operation. The upper and lower limits are sent to the coding band 
arrangement information generation unit 200604, as coding band information 200702. Here, k indicates the number for 
handling the coding band and, as the k approaches from 0 closer to the maximum number pmax which has previously 
been set, it indicates a higher-frequency band. For example, pmax is 4. An example of operation of the coding band 
calculation unit 200601 is shown in Table 2. 



Table 2 
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= 24kHz, total bit rate = 24kbps 



[01 20] The psychoacoustic model calculation unit 200602 calculates a psychoacoustic weight 200605, based on psy- 
40 choacoustic characteristics of human beings, from the spectrum information such as the output signal from the filter 701 
or the difference spectrum 200108 output from the coding band control unit 200110, and the coding band information 
200702 output from the coding band calculation unit 200601 . The psychoacoustic weight 200605 has a relatively large 
value for a band which is psychoacoustically important, and a relatively small value for a band which is psychoacousti- 
cally not so important. An example of psychoacoustic model calculation is calculating the power of input spectrum. 
45 Assuming that the input spectrum is x 602 (i), the psychoacoustic weight w psy (k) is represented by 

•p^- H i{"-» (18) 

50 

[01 21 1 The psychoacoustic weight 200605 so calculated is input to the arrangement decision unit 200603, wherein a 
band at which the psychoacoustic weight 200605 amounts to the maximum is calculated with reference to the analysis 
scale 503 on the following condition. To be specific, when the analysis scale 503 is small (e.g., 1 28), the psychoacoustic 
55 weight 200605 of a band having a large band number 200606 (e.g., 4) is increased, for example, to be twice, while when 
the analysis scale is not small, the psychoacoustic weight 200605 is used as it is. Then, the band number 200606 is 
sent to the coding band arrangement information generation unit 200604. 

[0122] The coding band arrangement information generation unit 200604 receives the coding band information 
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200702, the band number 200606, and the coding condition 2001 05, and outputs coding band arrangement information 
200109. To be specific, the coding band arrangement information generation unit 200604 outputs, with referring to the 
coding condition 200105, the coding band arrangement information 200109 comprising the coding band information 
200702 and the band number 200606 being connected, as long as the coding band arrangement information 200109 

s is required. When the coding band arrangement information 200109 becomes unnecessary, the coding band arrange- 
ment information generation unit 200604 stops outputting the information 200109. For example, the unit 200604 con- 
tinues to output the band number 200606 until the number of encoders which is specified by the coding condition 
200105 is attained. Further, when the analysis scale 503 is small, the output band number 200606 may be fixed in the 
arrangement decision unit 200603. 

10 [01 23] Next, the operation of the coding band control unit 2001 1 0 will be described with reference to figure 1 7. 
[01 24) The coding band control unit 2001 10 receives the coding band arrangement information 200109 output from 
the characteristic decision unit 200107 and the spectrum 505 of the original audio signal, and outputs the code 
sequence 20011 1 and the difference spectrum 200108. The coding band control unit 200110 comprises a spectrum 
shift means 200701 which receives the coding band arrangement information 200109, and shifts the difference spec- 

15 trum 200108 between the spectrum 505 of the original audio signal and the decoded spectrum 200705 obtained by 
coding the spectrum 505 of the original audio signal in the past and decoding the same, to the band of the band number 
200606; an encoder 2003; a difference calculation means 200703 which takes a difference between the spectrum 505 
of the original audio signal and the decoded spectrum 200705; a difference spectrum holding means 200704; and a 
decoding band control unit 200153 which subjects the composite spectrum 2001001 which is obtained by the code 

20 sequence 200111 being decoded by the decoder 2004, to the spectrum shifting using the coding band arrangement 
information 200702, and calculates the decoded spectrum 200705b by-using the shifted composite spectrum. The 
structure of the spectrum shift means 200701 is shown in figure 20. The spectrum shift means 200701 receives the 
original spectrum 2001 101 to be shifted and the coding band arrangement information 200109. Amongst the inputs to 
the spectrum shift means 200701 , the spectrum 2001 101 to be shifted is either the spectrum 505 of the original audio 

25 signal or the difference spectrum 2001 08, and the spectrum shift means 200701 shifts the spectrum to the band of the 
band number 200606 to output the shifted spectrum 2001 102 and the coding band information 200702 included in the 
coding band arrangement information 200109. The band corresponding to the band number 200606 is obtained from.; 
fpl(k): and fpu(k) of the coding band information 200702. The shifting procedure is to move the spectrums between ; fpl(k);- 
and fpu(k) up to the band which can be processed by the encoder 2003. t, * ? 

• 30 [01 25] The encoder 2003 receives the spectrum 2001 1 02 so shifted, and outputs a normalized code sequence: 303 J 
? and a residual code sequence 304 as shown in figure 1 5. These sequences 303 and 304 and the coding band informa- : - f . 
tion 200702 which is output from the spectrum shift means 200701 are output as a code sequence 2001 1 1 to the trans:: : . 
mission code composition unit 2001 1 2 and to the decoding band control unit 2001 53. 

[0126] The code sequence 2001 1 1 output from the encoder 2003 is input to the decoding band control unit 200153 
35 in the coding band control unit 2001 1 . The decoding band control unit 200153 operates in the same manner as the 
decoding band control unit 200153b included in the decoding apparatus 2002. 
[0127] The structure of the decoding band control unit 200153b is shown in figure 19. 

[0128] The decoding band control unit 200153b receives the code sequence 200111 from the transmitted code 
sequence decomposition unit 200150, and outputs a decoded spectrum 200705b. The decoding band control unit 
40 2001 53 includes a decoder 2004, a spectrum shift means 200701 , and a decoded spectrum calculation unit 2001 003b. 
[0129] The structure of the decoder 2004 is shown in figure 18. 

[0130] . The decoder 2004 comprises an inverse quantization unit 1 101 and an inverse normalization unit 1 102. The 
inverse quantization unit 1 101 receives the residual code sequence 304 in the code sequence 2001 1 1 , transforms the 
residual code sequence 304 to a code index, and reproduces the code by referring to the code book used in the 
45 encoder 2003. The reproduced code is sent to the inverse normalization unit 1 102, wherein the code is multiplied by 
the normalized coefficient sequence 303a reproduced from the normalized code sequence 303 in the code sequence 
2001 11, to produce a composite spectrum 2001001. The composite spectrum 2001001 is input to the spectrum shift 
means 200701. 

[0131 ] Although the output of the decoding band control unit 2001 53 included in the coding band control unit 2001 10 
so is the decoded spectrum 200705, this is identical to the composite spectrum 2001001 which is output from the decoding 
band control unit 2001 53 included in the decoding apparatus 2002. 

[0132] The composite spectrum 2001001 obtained by the decoder 2004 is shifted by the spectrum shift means 
200701 to be a shifted composite spectrum 2001002, and the shifted composite spectrum 2001002 is input to the 
decoded spectrum calculation unit 2001003. 
55 [0133] In the decoded spectrum calculation unit 2001003, the input composite spectrum is retained, and this spec- 
trum is added to the latest composite spectrum to generate the decoded spectrum 200705b to be output. 
[0134] The difference calculation means 200703 in the coding band control unit 200110 calculates a difference 
between the spectrum 505 of the original audio signal and the decoded spectrum 200705 to output a difference spec- 



19 



EP 0 942 411 A2 



trum 200108, and this spectrum 200108 is fed back to the characteristic decision unit 200107. At the same time, the 
difference spectrum 200108 is held by the difference spectrum holding means 200704 to be sent to the spectrum shift 
means 200701 for the next input of the coding band arrangement information 2001 09. In the characteristic decision unit 
200107, the coding band arrangement information generation means continues outputting the coding band arrange- 

5 ment information 200109 with reference to the coding condition until the coding condition is satisfied. When the output 
of the coding band arrangement information 200109 is stopped, the operation of the coding band control unit 200110 
is also stopped. The coding band control unit 2001 10 has the difference spectrum holding means 200704 for the calcu- 
lation of the difference spectrum 200108. The difference spectrum holding means 200704 is a storage area for holding 
difference spectrums, for example, an array capable of storing 2048 pieces of numbers. 

10 [01 35] As described above, the process of the character decision unit 200107 and the subsequent process of the cod- 
ing band control unit 2001 1 0 are repeated to satisfy the coding condition 2001 05, whereby the code sequences 2001 1 1 
are successively output and transmitted to the transmission code sequence composition unit 2001 12. In the transmis- 
sion code sequence composition unit 200112, the code sequences 200111 are composited with the analysis scale 
code sequence 510 to generate a transmission code sequence. The composite code sequence is transmitted to the 

is decoding apparatus 2002. 

[0136] In the decoding apparatus 2002, the transmission code sequence transmitted from the coding apparatus 2001 
is decomposed to a code sequence 200151 and an analysis scale code sequence 200152 by the transmission code 
sequence decomposition unit 200150. The code sequence 200151 and the analysis scale code sequence 200152 are 
identical to the code sequence 200111 and the analysis scale code sequence 510 in the coding apparatus 2001, 

20 respectively. 

[0137] The code sequence 2001 51 is transformed to a decoded spectrum 200154b in the decoding band control unit 
200153b, and the decoded spectrum 200154b is transformed to a time-domain signal in the frequency-to-time transfor- 
mation unit 5, the window multiplication unit 6, and the frame overlapping unit 7, by using the information of the analysis 
scale code sequence 200152, resulting in a decoded signal 8. 

25 [01 38] As described above, the audio signal coding and decoding apparatus according to the second embodiment is 
similar to the first embodiment in being provided with the characteristic decision unit which decides the frequency band 
of an audio signal to be quantized by each encoder of multiple-stage encoders; and the coding band control unit which 
receives the frequency band decided by the characteristic decision unit, and the time-to-frequency transformed original 
audio signal as inputs, and decides the connecting order of the encoders and transforms the quantization bands of the 

30 respective encoders and the connecting order to code sequences, thereby performing adaptive scalable coding. In this 
second embodiment, the coding apparatus further includes the coding band control unit including the decoding band 
control unit, and the decoding apparatus further includes a decoding band control unit. Further, the spectrum power cal- 
culation unit included in the characteristic decision unit of the first embodiment is replaced with the psychoacoustic 
model calculation unit and, further, the characteristic decision unit includes the coding band arrangement information 

35 generation means. Since the spectrum power calculation unit in the characteristic decision unit is replaced with the psy- 
choacoustic model calculation unit, psychoacoustically important part (band) of the audio signal is accurately judged, 
whereby this band can be selected more frequently. Further, while in the audio signal coding and decoding apparatus 
of the present invention, when the coding condition is satisfied during executing the operation to decide the arrange- 
ment of the encoders, the coding process is decided as satisfied and no coding band arrangement information is output, 

40 in the operation to decide the arrangement of the encoders, the respective band widths when selecting the bands for 
arranging the encoders and the weights of the respective bands are fixed in the characteristic decision unit in the first 
embodiment of the invention. To the contrary, in this second embodiment, since the judgement condition of the charac- 
teristic decision unit includes the sampling frequency of the input signal and the compression ratio, i.e., the bit rate at 
coding, the degree of weighting on the respective frequency bands when selecting the arrangement of the encoders in 

45 the respective bands can be varied. Further, since the judgement condition of the characteristic decision unit includes 
the compression ratio, by performing such control that when the compression ratio is high (i.e., when the bit rate is low), 
the degree of weighting on selecting the respective bands is not varied very much when the compression ratio is low 
(i.e., when the bit rate is high), the degree of psychoacoustic weighting on selecting the respective bands is much 
changed so as to emphasize psychoacoustically important part to improve the efficiency, the best balance between the 

so composition ratio and the quality can be obtained. As the result, the audio signal coding and decoding apparatus 
according to this second embodiment exhibits sufficient performance when coding various audio signals. 

Claims 

55 1 . An audio signal coding apparatus receiving an audio signal which has been time-to-frequency transformed, and 
outputting a coded audio signal, said apparatus comprising: 

a first-stage encoder for quantizing the time-to-frequency transformed audio signal; 
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second-and-subsequent-stages of encoders each for quantizing a quantization error output from the previous- 
stage encoder; 

a characteristic decision unit for judging the characteristic of the time-to-frequency transformed audio signal, 
and deciding the frequency band of the audio signal to be quantized by each of the encoders in the multiple 
5 stages; and 

a coding band control unit for receiving the frequency band decided by the characteristic decision unit and the 
time-to-frequency transformed audio signal, deciding the connecting order of the respective encoders in each 
of the multiple stages, and transforming the quantization bands of the respective encoders and the connecting 
order of the encoders to code sequences. 

10 

2. The audio signal coding apparatus of Claim 1 wherein each of the encoders comprises: 

a normalization unit for calculating a normalized coefficient sequence for normalizing the time-to-frequency 
transformed audio signal, from the audio signal, quantizing the normalized coefficient sequence by using a 
15 vector quantization method, and outputting a normalized signal obtained by normalizing the time-to-frequency 

audio signal; and 

at least one stage vector quantization unit for quantizing the signal normalized by the normalization unit. 

3. The audio signal coding apparatus according to Claim 1 or 2, wherein the coding band control unit selects a fre- 
20 quency band having an energy addition sum of quantization error larger than a predetermined value, as a fre- 
quency band of the audio signal to be quantized by each encoder. - - 

4. The audio signal coding apparatus according to Claim 1 or 2 wherein said coding band control unit selects a fre- 
quency band having an energy addition sum of quantization error larger than a predetermined value, which band 

25 is heavily weighted with regard to psychoacoustic characteristics of human beings, as a frequency band of the 
audio signal to be quantized by each encoder. 

5. The audio signal coding apparatus according to Claim 1 or 2 wherein said coding band control unit retrieves, at 
least once, the whole frequency band of the input audio signal. 

30 . . . 

6. The audio signal coding apparatus of Claim 2 wherein said vector quantization unit calculates the quantization error 
in vector quantization by using a vector quantization method with a code book, and outputs the result of the vector 
quantization as a code sequence. 

35 7. The audio signal coding apparatus of Claim 6 wherein said vector quantization unit uses, for retrieval of on optimum 
code in the vector quantization, a code vector in which all or part of the codes of the vector is inverted. 

8. The audio signal coding apparatus of Claim 6 wherein said vector quantization unit extracts, in calculateing dis- 
tances which are used for retrieving an optimum code in vector quantization, a code giving the minimum distance 

40 by using the normalized coefficient sequence of the input signal calculated by the normalization unit as a weight. 

9. The audio signal coding apparatus of Claim 6 wherein said vector quantization unit extracts, in calculating dis- 
tances which are used for retrieving an optimum code in vector quantization, a code giving the minimum distance 
by using, both of the normalized coefficient sequence calculated by the normalization unit and a value in consider- 

45 ation of psychoacoustic characteristics of human beings as weights. 

10. An audio signal decoding apparatus for decoding a coded audio signal which is output from the audio signal coding 
apparatus of Claim 1 to output an audio signal, said apparatus comprising: 

so an inverse quantization means comprising a single inverse quantizer or multiple-stages of inverse quantizers, 

for reproducing the coefficient sequence of the time-to-frequency transformed audio signal, from the input 
audio signal code sequence, on the basis of the quantization bands of the respective encoders of each of the 
multiple stages and the connecting order of these encoders, which are decided by the characteristic decision 
unit and the coding band control unit included in the audio signal coding apparatus; and 

55 a frequency-to-time transformation unit for transforming the output of the inverse quantization means, which is 

the coefficient sequence of the time-to-frequency transformed audio signal, to a signal corresponding to the 
original audio signal. 
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11. The audio signal decoding apparatus of Claim 10 wherein: 

said inverse quantization means comprising a single stage inverse quantizer or each of inverse quantizers of 
multiple stages receives the code sequences output from the encoders of the respective frequency bands of 

5 the audio signal coding apparatus according to Claim 2, and reproduces the coefficient sequence of the time- 

to-frequency transformed audio signal from the input audio signal code sequences; 
said inverse quantization means includes an inverse normalization unit for receiving the coefficient sequence 
of the time-to-frequency transformed audio signal, which is output from the inverse quantization means, and 
the normalized code sequences output from the encoders of the respective frequency bands in the audio sig- 

10 nal coding apparatus, and obtaining a signal corresponding to the time-to-frequency transformed audio signal; 

and 

said frequency-to-time transformation unit transforms the output of the inverse normalization unit to a signal 
corresponding to the original audio signal. 

15 12. The audio signal decoding apparatus according to Claim 10 or 1 1, wherein said inverse quantization means per- 
forms inverse quantization by using only the codes which are output from some of the plurality of encoders in the 
audio signal coding apparatus. 

13. The audio signal coding apparatus of Claim 1 wherein said characteristic decision unit properly selects a band to 
20 be quantized in accordance with a signal obtained by processing the time-to-frequency transformed audio signal 

input to the characteristic decision unit by a low-pass filter. - - 

14. The audio signal coding apparatus of Claim 1 wherein said characteristic decision unit properly selects a band to 
be quantized, in accordance with a signal obtained by subjecting the time-to-frequency transformed audio signal 

25 input to the characteristic decision unit to a processing including logarithmic calculation. 

■15. The audio signal coding apparatus of Claim 1 wherein said characteristic decision unit properly selects a band to 
be quantized, in accordance with a signal obtained by processing the time-to-frequency transformed audio signal 
ii input to the characteristic decision unit by a high-pass filter. 

•16. The audio signal coding apparatus of Claim 1 wherein said characteristic decision unit properly selects a band to 
. be quantized in accordance with a signal obtained by processing the time-to-frequency transformed audio signal 
input to the characteristic decision unit by a band-pass filter or a band-rejection filter. 

35 1 7. The audio signal coding apparatus of Claim 1 wherein said characteristic decision unit decides the characteristic of 
the input audio signal, and properly selects a band to be quantized by each encoder in accordance with the result 
of the decision. 

18. The audio signal coding apparatus of Claim 17 wherein said characteristic decision unit decides the characteristic 
40 of the input audio signal and restricts the band to be quantized by each encoder in accordance with the result of 

the decision. 

19. The audio signal coding apparatus of Claim 18 wherein, when the frequency band is divided into a low-band, an 
intermediate-band, and a high-band and the bands to be quantized by the respective encoders are to be restricted, 

45 and when the input audio signal has variable characteristics, the bands to be quantized are controlled so that the 
high-band is selected more than the other bands. 

20. The audio signal coding apparatus of Claim 18 wherein, when the band is divided into a low-band, an intermediate- 
band, and a high-band and the high-band is selected more than the other bands for the bands to be quantized by 

so the respective encoders, the bands to be quantized are controlled so that most of the bands to be quantized are in 
the high-band, for a predetermined period from when the high-band is selected. 

21. The audio signal coding apparatus of Claim 18 wherein, the band is divided into a low-band, an intermediate-band 
and a high-band, and the characteristic of the original input audio signal is judged, and the bands to be quantized 

55 by the respective encoders are fixed dependent on the result of the judgment 

22. The audio signal coding apparatus of Claim 1 wherein said characteristic decision unit uses one or both of the fre- 
quency outline of the time-to-frequency transformed audio signal and the normalized coefficient sequence calcu- 
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lated by the normalization unit, as a weight or weights for deciding the quantization band of the respective 
encoders. 

23. The audio signal coding apparatus of Claim 1 further comprising: 

5 

a characteristic decision unit for judging phycho acoustic and physical characteristics of the audio signal to be 
quantized by the respective encoders of each stage; 

a coding band control unit for controlling the arrangment of the bands to be quantized by the respective encod- 
ers of each stage, in accordance with the coding band arrangement information decided by the characteristic 
10 decision unit; and 

the processings by the characteristic decision unit and the coding band control unit being repeated until prede- 
termined coding condition is satisfied. 

24. The audio signal coding apparatus of Claim 23 wherein said characteristic decision unit comprises: 

15 

a coding band calculation unit which receives predetermined coding condition and calculates coding band 
information indicating the coding bands of the respective encoders of each stage; 

a psychoacoustic model calculation unit which receives the coding band information, the output of a predeter- 
mined filter which filters one of a frequency-domain audio signal and a difference spectrum, and outputting a 
20 psychoacoustic weight representing the phycho acoustic importance in the coding bands of the coding band 

information; - - 

an arrangement decision unit which receives the psychoacoustic weight and an analysis scale output from an 
analysis scale decision unit, determines the arrangement of the encoders, and outputs the band numbers of 
the encoders; and 

25 a coding band arrangement information generation unit which receiving the coding band information and the 

band numbers, and outputs coding band arrangement information in accordance with the predetermined cod- 
ing condition. 

25. The audio signal coding apparatus of Claim 23 where is said coding band control unit comprises: 
30 ■ ■ ■ 

spectrum shift means which receives the time-to-frequency transformed audio signal and the coding band 
arrangement information and shifts the spectrum of the input audio signal to a specified band; 
an encoder which encodes the output of the spectrum shifting means, to output a code sequence; 
a decoding band control unit which decodes the code sequence output from the encoder to output a decoded 
35 spectrum; 

difference calculation means which calculates a difference between the decoded spectrum and the time-to-fre- 
quency transformed audio signal; and 

difference spectrum holding means which holds the current difference information up to the next operation 
period of the coding band control unit. 

40 

26. The audio signal coding apparatus of Claim 25 wherein said decoding band control unit comprises: 

a decoder which decodes the code sequence, to output a composite spectrum; 

spectrum shift means for shifting the composite spectrum to a specified band, in accordance with the coding 
45 band arrangement information included in the code sequence; and 

a decoded spectrum calculation unit which holds the current composite spectrum up to the next operation 
period of the decoding band control unit starts and adds the past composite spectrum and the current compos- 
ite spectrum. 

so 27. An audio signal decoding apparatus for decoding a coded audio signal which is output from the audio signal coding 
apparatus of Claim 26 to output on audio signal, which further comprises a decoding band control unit which has 
the same structure as the decoding band control unit included in the audio signal coding apparatus. 

28. An audio signal coding and decoding apparatus comprising the audio signal coding apparatus of Claim 26 and an 
55 audio signal decoding apparatus for decoding a coded audio signal output from the audio signal coding apparatus 
to output an audio signal, wherein said audio signal decoding apparatus includes a decoding band control unit 
which has the same structure as the decoding band control unit included in the audio signal coding apparatus. 
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29. The audio signal decoding apparatus of Claim 27 wherein the spectrum shift means included in the audio signal 
coding apparatus receives the spectrum to be shifted and the coding band arrangement information, and outputs 
the coding band information and the shifted spectrum. 

30. The audio signal coding apparatus of Claim 24 wherein, when the input audio signal has rapidly changing charac- 
teristics, i.e., the analysis scale is small, said arrangement decision unit controls the coding bands of the respective 
encoders so that the high-band is selected more than the other bands. 

31 . The audio signal coding apparatus of Claim 24 wherein, when the input audio signal has rapidly changing charac- 
teristics, i.e., the analysis scale is small, said arrangement decision unit controls the coding bands so that the high- 
band is selected more than the other bands for a predetermined period from when the high-band is selected. 

32. The audio signal coding apparatus of claim 24 wherein said coding band calculation unit has a functional relation 
between the coding band information which is the output of the coding band calculation unit and the bit rate or the 
sampling frequency of the input signal included in the input coding condition, which functional relation comprising 
one of a polynomial function, a logarithmic function, and a combination of these functions. 

33. The audio signal coding apparatus of Claim 32 wherein, when the total number of the encoders is three or more as 
one of the coding condition, the upper limit of the coding band of the third encoder in the order of increasing fre- 
quency is at least half of the frequency band of the original audio signal. 

34. The audio signal coding apparatus of Claim 32 wherein said coding band calculation unit employs as the function 
making the functional relation, a function having weighting in consideration of psychoacoustic characteristics of 
human beings, such as a Bark scale and Mel coefficients. 

35. The audio signal coding apparatus of Claim 24 wherein said arrangement decision unit determines the arrange- 
» ment of the bands to be coded by the respective encoders of each stage; and 

a plurality of patterns of arrangement of the respective encoders which are prepared in advance, are used with . 
switched between these patterns so as to improve the coding efficiency. 

36. The audio signal coding apparatus of Claim 24 wherein, when the characteristic of the input audio signal is station- 
ary no much rapid change and the analysis scale is large, the arrangement decision unit has a small value as the 
maximum value of the band to be coded by the respective encoders of each stage. 

37. The audio signal coding apparatus of Claim 24 wherein a filter to be connected at a previous stage to the respective 
encoders is one of a low-pass filter, a high-pass filter, a band-pass filter, and a band-rejection filter, or a combination 
of two or more of these filters. 

38. The audio signal decoding apparatus of Claim 27 wherein said inverse quantization unit performs inverse quanti- 
zation by using only part of codes which are output from the audio signal coding apparatus. 
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